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METHOD AND APPARATUS FOR TUNING CONTENT OF INFORMATION 



PRESENTED TO AN AUDIENCE 



5 - Field of the Invention 

The present invention relates to a method and apparatus 
for presenting information to an audience, and more particularly, 
to a method and apparatus for tuning the content of information 
that is presented, for example, on a large display screen or an 
10 information kiosk, to an audience. 

Background of the Invention 

The impact of advertising and other presented 
^ information can be significantly increased if the content can be 

]§ adapted to a given target audience. The success of any 
^ advertising campaign, for example, requires that the 
Hi advertisements reach the target audience. Generally, a 

ry particular advertising or informative message is targeted for one 
p or more segments of a population, with media planners determining 

S); the best way to reach the target audience. 

%j Typically, prior to executing an advertising campaign, 

2 media planners attempt to predict the best media options to reach 
a target audience. In addition, during a given advertising 
campaign, it is helpful to measure the exposure of the target 

25 audience to the advertising messages, since media planners might 
make corrections in order to optimize the implementation of the 
media plan. Likewise, after a given advertising campaign, media 
planners often analyze the advertising campaign to confirm that 
the advertising messages reached the target audience. 

30 While the audience demographics associated with most 

media vehicles are well defined, the dynamic nature of some media 
vehicles makes predicting the audience demographics in advance 
difficult, if not impossible. For example, large screen 
displays, such as information kiosks, are often utilized in 

35 public places to present advertisements and other information to 
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people passing by the displays. Typically, the content that is 
presented to the public on such a display is generally suitable 
for the location where the display is installed. For example, 
* airports and other transportation terminals often use such 
5, displays to present schedules and other information of interest 
to passengers. 

Thus, tailoring the content to such a dynamic audience 
is difficult. While such displays and information kiosks have 
been effective for presenting general information to large 
10 audiences, they suffer from a number of limitations, which if 
overcome, could greatly expand their utility and effectiveness. 
Specifically, since the demographics of the audience in such 
yj public places cannot be accurately predicted in advance, any 
jt! presented content must generally appeal to the population at 
151 large. 

fl A need therefore exists for a method and apparatus for 

|y automatically evaluating the demographics of an audience in real- 
L time and for tuning the content of information that is presented 
CP on a large display screen or an information kiosk to the current 
i§ audience. A further need exists for a method and apparatus for 
O evaluating the reaction of an audience to presented content in 
^ real-time. Yet another need exists for a method and apparatus 
for estimating the size of an audience in real-time. Finally, a 
need exists for a method and apparatus for generating reports on 
25 the exposure of various population segments to presented content. 
In this manner, the reports provide a feedback mechanism that 
allows the content providers and advertisers to reach the target 
audience in an efficient manner. 

30 Summary of the Invention 

Generally, a method and apparatus are disclosed for 

tuning the content of information presented, for example, on a 

large display screen or an information kiosk, to an audience, A 
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disclosed content selection and driving system (i) extracts 
relevant characteristics about the audience, (ii) analyzes the 
characteristics, (iii) modifies the presented content based on 
the analysis, and (iv) records relevant statistics for reporting. 
5, The content selection and driving system evaluates the 

impact of advertising or information displayed on the display. 
An audio/visual analyzer derives audience characteristics and 
other information on the public reaction to the presented 
advertising or information by analyzing audio or video 
10 information, or both. In one illustrative embodiment, the 
audio/visual analyzer can derive (i) various demographic 
J statistics, including gender, race or age statistics; (ii) the 
3; current size of the audience; (iii) how quickly the audience is 
hi changing; and (iv) how much attention the audience is paying to 
rf^ the presented advertising or information. 

m The derived characteristics are utilized by a dynamic 

!L content selector to tune the content of the presented advertising 
m or information to the characteristics of the current audience. 
l y The dynamic content selector utilizes the derived audience 
28) statistics, and optionally offline statistics about the local 
^ environment, to select the appropriate content for the current 
audience from a content database. 

A reporting module is disclosed that receives the real- 
time audience statistics from the audio/visual analyzer and an 
25 indication of the selected content from the dynamic content 
selector. Reports can be generated for the content provider, 
such as advertisers, that indicate the exposure of various 
population segments to the presented content and the reaction of 
the audience to the presented content, thereby providing a 
30 feedback mechanism that allows the content providers and 
advertisers to effectively reach the target audience. 

A more complete understanding of the present invention, 
as well as further features and advantages of the present 
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invention, will be obtained by reference to the following 
detailed description and drawings. 



Brief Description of the Drawings 

5. FIG. 1 illustrates a content selection and driving 

system in accordance with the present invention; 

FIG. 2 is a schematic block diagram of the audio/visual 
analyzer of FIG. 1; 

FIG. 3 is a schematic block diagram of the dynamic 
10 content selector of FIG. 1; 

FIG. 4 is a sample table illustrating an exemplary 
P content database of FIG. 1; 

y3 FIG. 5 is a flow chart describing an exemplary audience 

n demographic analysis process employed by the audio/visual 
M analyzer of FIG. 2 and embodying principles of the present 
yj invention; 

FIG. 6 is a flow chart describing an exemplary audience 
Q count process employed by the audio/visual analyzer of FIG. 2 and 
'%] embodying principles of the present invention; 

2QI FIG. 7 is a flow chart describing an exemplary audience 

t; turn-over evaluation process employed by the audio/visual 

analyzer of FIG. 2 and embodying principles of the present 

invention; 

FIG. 8 is a flow chart describing an exemplary audience 
25 attention evaluation process employed by the audio/visual 
analyzer of FIG. 2 and embodying principles of the present 
invention; 

FIG. 9 is a flow chart describing an exemplary content 
selection and driving process employed by the dynamic content 
30 selector of FIG. 3 and embodying principles of the present 
invention; and 

FIG. 10 illustrates an exemplary report generated in 
accordance with the present invention indicating the exposure of 
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various population segments to the presented content and the 
reaction of the audience to the presented content. 

Detailed Description 

5. fig . 1 illustrates a content selection and driving 

system 100 in accordance with the present invention. Generally, 
the content selection and driving system 100 (i) extracts 
relevant characteristics about the audience, (ii) analyzes the 
characteristics, (iii) modifies the presented content based on 

10 the analysis, and (iv) records relevant statistics for reporting. 
n As shown in FIG. 1, one or more audio/visual capture 
'C devices 120-1 through 120-N (hereinafter, collectively referred 
Q to as audio/visual capture devices 120) are focused on an 
^ audience 130 that is viewing a display 110, such as a large 
IB screen display or an information kiosk. In one embodiment, the 
^ display 110 may be embodied as the Access Point™ information 
O kiosk, commercially available from Philips Electronics, N.A. 

11 Typically, the display 110 may be installed in a public place, 
SJ such as an airport, transportation terminal, shopping mall, 
M museum or the like. The audio/visual capture devices 120 may 

include, for example, a pan- tilt-zoom (PTZ) camera for capturing 
video information or an array of microphones for capturing audio 
information, or both. 

It is noted that the composition of the audience 130 

25 may vary over time, depending, at least in part, on the nature of 
the location where the display 110 is installed. One feature of 
the present invention, discussed below in conjunction with FIG. 
7, evaluates the rate of change of the audience 13 0. In this 
manner, if the audience is not changing quickly, the content 

30 selection and driving system 100 can select longer advertising 
messages or programs, or more detailed information. If the 
content selection and driving system 100 determines that the 
audience is moving and changing more quickly over time, shorter 
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advertising messages or programs, or less detailed information, 
can be presented. 

The content selection and driving system 100 evaluates 
the impact of advertising or information displayed on the display 
5. 110. As shown in FIG. 1, the content selection and driving 
system 100 includes a audio/visual analyzer 200, discussed below 
in conjunction with FIG. 2, that derives audience characteristics 
and other information on the public reaction to the presented 
advertising or information by analyzing audio or video 
10 information, or both. As discussed further below in conjunction 
with FIGS. 5 through 8, the audio/visual analyzer 200 can extract 
O various types of information about the audience from the audio or 
ffi video information, or both. In the illustrative embodiment, the 

H audio/visual analyzer 200 can derive (i) various demographic 

jj u n 

lS statistics, including gender, race or age statistics; (ii) the 
2t current size of the audience; (iii) how quickly the audience is 
= changing; and (iv) how much attention the audience is paying to 

2 the presented advertising or information. 

p The derived characteristics could be utilized by a 

2$ dynamic content selector 300, discussed below in conjunction with 

3 FIG. 3, to tune the content of the presented advertising or 
information to the characteristics of the current audience. For 
example, the content selection and driving system 100 may store 
two versions of an advertisement for a given product, with one 

25 version targeting men and the second version targeting women. 
The content selection and driving system 100 can dynamically 
select one version over the other based on a dynamic 
determination of the current gender composition of the audience 
13 0. As shown generally in FIG. 1, and discussed further below, 

30 the dynamic content selector 3 00 utilizes the derived audience 
statistics and offline statistics about the local environment, 
such as historical audience demographics, or flight or train 



C:\TEMP\~0040635 .doc 



schedules, to select the appropriate content for the current 
audience from a content database 400. 

In addition, the content selection and driving system 
" 100 includes a reporting module 150 that receives the real-time 
5, audience statistics from the audio/visual analyzer 200 and an 
indication of the selected content from the dynamic content 
selector 300. The reporting module 150 includes a report 
generator 160 that produces reports, discussed further below in 
conjunction with FIG. 10, for the content provider, such as 
10 advertisers. Generally, the reports indicate the exposure of 
various population segments to the presented content and the 
O reaction of the audience to the presented content, thereby 
providing a feedback mechanism that allows the content providers 
and advertisers to effectively reach the target audience. For 
example, the reports produced by the report module 150 can 
indicate the size and rate of change of the audience, as well as 
s various demographics of the audience, such as age, race, or 
^ gender. As discussed further below in conjunction with FIG. 2, 
n : these audience statistics are generated by the audio/visual 
2JS. analyzer 200. 

O FIG. 2 is a block diagram showing the architecture of 

an illustrative audio/visual analyzer 200 in accordance with the 
present invention. The audio/visual analyzer 200 may be embodied 
as a general purpose computing system, such as the general 

25 purpose computing system shown in FIG. 2. As shown in FIG. 2, 
the audio/visual analyzer 200 preferably includes a processor 210 
and related memory, such as a data storage device 220, which may 
be distributed or local. The processor 210 may be embodied as a 
single processor, or a number of local or distributed processors 

30 operating in parallel. The data storage device 220 and/or a read 
only memory (ROM) (not shown) are operable to store one or more 
instructions, which the processor 210 is operable to retrieve, 
interpret and execute. The audio/visual analyzer 200 receives 
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audio or video signals, or both, from the audio/visual capture 
devices 120. The audience characteristics derived by the 
audio/visual analyzer 200 from the audio/video information is 
presented to the dynamic content selector 300 for further 
processing . 

As discussed further below in conjunction with FIGS. 5 
through 8, the data storage device 220 includes an audience 
demographic analysis process 500, an audience count process 600, 
an audience turn-over evaluation process 700 and an audience 
attention evaluation process 800. Generally, the audience 
demographic analysis process 500 evaluates facial and body 
features of the audience to segment the audience based on one or 
more desired demographics, such as age, race, or gender. The 
audience count process 600 analyzes the video image to identify 
distinctive human features, such as a body, head and facial 
feature hierarchy, and then counts the individuals in the image 
to estimate the size of the audience. The audience turn-over 
evaluation process 700 generates an evaluation of how quickly the 
audience is changing. The audience attention evaluation process 
800 evaluates the audio or video information, or both, to 
identify behavior that suggests whether or not the audience is 
paying attention to the presented advertising or information, 
such as reading a newspaper, playing games, speaking, or facing 
the display. 

FIG. 3 is a block diagram showing the architecture of 
an illustrative dynamic content selector 3 00 in accordance with 
the present invention. The dynamic content selector 300 may be 
embodied as a general purpose computing system, such as the 
general purpose computing system shown in FIG . 3 . The dynamic 
content selector 300 includes certain standard hardware, such as 
processor 310 and related memory, such as a data storage device 
3 20, as discussed above in conjunction with the audio/visual 
analyzer 200 (FIG. 2). It is noted that the audio/visual 
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analyzer 200 and dynamic content selector 300 may optionally be 
integrated using a single general purpose computing system. 

As shown in FIG. 3, the data storage device 320 
" includes an offline statistics database 340, a content selection 
5, and driving process 900 and a dynamic content evaluator process 
1000. Generally, the offline statistics database 340 contains 
information relevant to the local environment where the display 
110 is installed. For example, the offline statistics database 
34 0 may include historical demographic information on the 
10 audience 130 for this location. Thus, the content can be 
selected on the basis of such historical information in the 
O absence of instantaneous information. In a further variation, 
Js the offline statistics database 340 can contain flight, bus or 
O train schedule information if the display 110 is installed in a 
lS transportation terminal. In this manner, the dynamic content 
W selection can supplemented using the likely destination of the 
L." passengers. 

O As discussed further below in conjunction with FIG. 9, the 
Ti\ content selection and driving process 900 selects advertising or 
2]f other information to present to the audience 130 based on the 
S current characteristics of the audience or off-line information 
or both. 

FIG. 4 illustrates an exemplary content database 400 
that stores information on the advertisements and other 

25 information that can be presented to the audience 13 0. The 
content database 400 maintains a plurality of records, such as 
records 405 through 420, each associated with a different content 
selection. For each content identifier listed in field 430, the 
content database 400 includes a brief description in field 440, 

30 and indicates the corresponding target audience and length in 
fields 450 and 4 60, respectively. In this manner, the content 
selection and driving process 900 can select content appropriate 
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for the current audience based on the information contained in 
fields 450 or 460 of the content database 400. 

PROCESSES 

As previously indicated, the audio/visual analyzer 200 
5. executes an audience demographic analysis process 500 , shown in 
FIG. 5, to evaluate to segment the audience based on one or more 
desired demographics, such as age, race, or gender. As shown in 
FIG. 5 r the audience demographic analysis process 500 receives 
one or more video images and identifies facial features during 
10 step 510. Thereafter, during step 520, the audience demographic 
analysis process 500 analyzes the facial features or height of 
Cl the individuals in the image to segment the audience based on one 
S or more desired demographics, such as age, race or gender. 
D The audience may be segmented on the basis of age using 

IJj the techniques taught, for example, in United States Patent 
W Number 5,781,650, issued to Lobo et al., incorporated by 
reference herein. Furthermore, an average distribution of age 
may be obtained by evaluating height information, in the manner 
rtj described in Antonio Criminisi et al., NX A New Approach to Obtain 
M Height Measurements from Video, " Proc. of SPIE, Boston, MA, Vol. 
O 3576 (November 1-6, 1998), incorporated by reference herein. The 
audience may be segmented on the basis of race using the skin- 
tone techniques taught, for example, in Face Guardian: Real-Time 
Face Verification Software that Recognizes Who You Are, 
25 http : //www. keywareusa . com/3 00__products/face_fs . html , 
incorporated by reference herein. The audience may be segmented 
on the basis of gender using the techniques taught, for example, 
in Baback Moghaddam and Ming-Hsuan Yang, "Gender Classification 
with Support Vector Machines," Proc. of the fourth IEEE 
30 International Conference on Automatic Face and Gesture 
Recognition, 306-11, Grenoble, France (March, 2000), incorporated 
by reference herein. It is noted that gender and age information 
can also be derived from the height information. 
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Finally/ the audience demographic analysis process 500 
generates a profile of the current audience during step 53 0 
before program control terminates . 

As previously indicated, the audio/visual analyzer 200 
5. executes an audience count process 600, shown in FIG. 6, to 
analyze the video image to identify distinctive human features, 
such as a body, head and facial feature hierarchy, and then count 
the individuals (e.g., heads) in the image to estimate the size 
of the audience. As shown in FIG. 6, the audience count process 
10 600 initially receives one or more video images and identifies 

human bodies, heads, and/or facial features during step 610. 
q Thereafter, during step 620, the audience count process 

i« 600 counts, for example, the heads in the image(s). The 
O body/head count may be performed using the techniques taught, for 
M example, in Patent W09932959, entitled * Method and System for 
W Gesture Based Option Selection, assigned to the assignee of the 
7 present invention, Damian Lyons and Daniel Pelletier, *A Line- 
C Scan Computer Vision Algorithm for Identifying Human Body 
Si Features," Gesture r 99, 85-96 France (1999), Ming-Hsuan Yang and 
M Narendra Ahuja, "Detecting Human Faces in Color Images," Proc. of 
Kj the 1998 IEEE Int'l Conf . on Image Processing (ICIP 98), Vol. 1, 
127-130, (October, 1998); and I. Haritaoglu, D. Harwood, L. 
Davis, "Hydra: Multiple People Detection and Tracking Using 
Silhouettes, " Computer Vision and Pattern Recognition, Second 
25 Workshop of Video Surveillance (CVPR, 1999), each incorporated 
by reference herein. Finally, the audience count process 600 
approximates the size of the audience 130 during step 630, before 
program control terminates . 

As previously indicated, the audio/visual analyzer 200 
30 executes an audience turn-over evaluation process 700, shown in 
FIG. 7, to generate an evaluation of how quickly the audience is 
changing. The audience turn-over evaluation process 700 

initially executes a flow rate routine to analyze the video 
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information and determine the number of individuals passing 
before the display 110 in a given time interval. The flow rate 
routine may be performed using the body/head count techniques 
taught in the references identified in the previous paragraph to 
5- track heads and compute how many people pass the display over 
time . 

Thereafter/ the audience turn-over evaluation process 
700 generates an evaluation of the turn-over rate of the audience 
130 , for example, in terms of number of individuals passing the 
10 display 

As previously indicated, the audio/visual analyzer 200 
0 executes an audience attention evaluation process 800 , shown in 
5; FIG. 8, to evaluate the audio or video information, or both, to 
C identify behavior that suggests whether or not the audience is 
lJS paying attention to the presented advertising or information, 
LJ such as reading a newspaper, playing games, speaking, or facing 
'J* the display. 

O As shown in FIG. 8, the audience attention evaluation 

m process 800 initially performs a test during step 810 to 
M determine if the audience is generally static, based, for 
n example, on the evaluation of the turn-over rate of the audience 
130 generated by the audience turn-over evaluation process 700. 
If it is determined during step 810 that the audience is not 
generally static, then program control returns to step 810 until 
25 the audience is generally static. Thus, the present invention 
assumes that if the turn-over rate of the audience exceeds a 
predefined threshold that the audience is not paying sufficient 
attention to warrant further evaluation. 

If, however, it is determined during step 810 that the 
30 audience is generally static, then the audience attention 
evaluation process 800 evaluates the audio or video information 
(or both) during step 820 to identify. For example, if a person 
is reading a newspaper, playing a game, speaking, or not facing 
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the display, the person is generally not likely to be paying 
attention to the presented content. 

Thus, the present invention identifies specific 
" behavior that is used to infer whether or not the audience is 
5. paying attention to the presented content. For example, the 
following behavior suggests whether an individual is likely 
paying attention to the content: facing the display, changing 
body pose to face the display, changing body expressions (visual, 
tracking of body features), changing facial expression as the 
10 message is displayed (visual), suddenly becoming silent (audio 
level down), or starting to laugh/concentrate because of the 
~i content (audio change) . 

fy] The audience attention evaluation process 800 can 

rt identify facial expressions (such as recognizing a change in 
HI facial expression) using the techniques described, for example, 
S in J.F. Cohn and G.S. Katz, ^Bimodal Expression of Emotion by 
s Face and Voice," Workshop on Face/Gesture Recognition and Their 
if Applications, 6 th ACM International Multimedia Conference (Sept., 
rU 1998), incorporated by reference herein. The audience attention 
2(| evaluation process 800 can identify Hallucinating Faces, using 
O the techniques described, for example, in S. Baker and T. Kanade, 
^Hallucinating Faces, " 4 th Int'l Conf . on Automatic Face and 
Gesture Recognition (March, 2000), incorporated by reference 
herein. The audience attention evaluation process 800 can 
25 identify embedded faces and facial expressions using the 
techniques described, for example, in Antonio Colmenarez et al, 
* Embedded Face and Facial Expression Recognition," Int'l Conf. on 
Image Processing, Kobe, Japan (1999), incorporated by reference 
herein . 

30 The audience attention evaluation process 800 can 

identify Body posture/pose using the techniques described, for 
example, in D. Anderson, "Occupational Biometrics" John Wiley and 
Son (2d Edition, 1991), and S. Iwasawa et al . , "Real-time, 3D 
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Estimation of Human Body Postures from Trinocular Images/' 
ICCV'99, Workshop on Modeling People, Corfu, Greece (1999), each 
incorporated by reference herein. The audience attention 
" evaluation process 800 can identify body features (such as head, 
5. hands or feet) to detect a change in the body expression using 
the techniques described, for example, in Damian Lyons and Daniel 
Pelletier, "A Line-Scan Computer Vision Algorithm for Identifying 
Human Body Features/' Gesture'99 France (1999), incorporated by 
reference herein. 

10 Finally, the audience attention evaluation process 800 

generates an evaluation of the audience attention during step 830 
r=* before program control terminates . 

y3 As previously indicated, the dynamic content selector 

p 300 executes a content selection and driving process 900, shown 
M in FIG . 9, to select advertising or other information to present 
T\ to the audience 13 0 based on the current characteristics of the 
^ J audience. The content selection and driving process 900 is 
G merely presented to illustrate a rule-based implementation for 
JfJ exemplary rules. In practice, each rule could be adapted for a 
2Qf given application, as would be apparent to a person of ordinary 
jrf skill in the art. 

As shown in FIG. 9, the content selection and driving 
process 900 initially receives audience statistics from the 
audio/visual analyzer 200 during step 910. The content selection 
25 and driving process 900 then performs a test during step 920 to 
determine if the statistics suggest that the current audience is 
primarily composed of a given segment (or demographic) . If it is 
determined during step 920 that the current audience is primarily 
composed of a given segment (or demographic), then content 
30 appropriate for the identified segment is selected during step 
930 based on the target audience field 450 in the content 
database 400. If, however, it is determined during step 920 that 
the current audience is not primarily composed of a given segment 
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(or demographic), then a further test is performed during step 
940 to determine if the turn-over rate suggests that the audience 
composition is changing slowly. 

If it is determined during step 940 that the turn -over 
5- rate suggests that the audience composition is changing slowly, 
then content having a longer duration, as indicated in field 460 
of the content database 400 is selected during step 950. If, 
however, it is determined during step 94 0 that the turn -over rate 
does not suggest that the audience composition is changing 
10 slowly, then general content having an average duration is 
selected during step 960 from the content database 400. 
*K Thereafter, program control terminates . As previously indicated, 
r according to one feature of the present invention, the reporting 
hi module 150 receives real-time audience statistics from the 
audio/visual analyzer 200 and an indication of the selected 
^ content from the dynamic content selector 3 00. The reporting 
*L module 150 produces reports indicating the exposure of various 
f- population segments to the presented content and the reaction of 
" v the audience to the presented content, thereby providing a 
2f| feedback mechanism that allows the content providers and 
^ advertisers to effectively reach the target audience. 

Generally, the generated reports can be customized to 
the needs of a given content provider and can include any 
statistics produced by the audio/visual analyzer 200 using the 
25 audience demographic analysis process 500, audience count process 
600, audience turn-over evaluation process 700 and audience 
attention evaluation process 800, discussed above in conjunction 
with FIGS. 5 through 8, respectively. 

FIG. 10 illustrates an exemplary report 1000 generated 
30 in accordance with the present invention indicating the exposure 
of various population segments to the presented content and the 
reaction of the audience to the presented content. The 
illustrative report 1000 includes a plurality of rows, such as 
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rows 1005 through 1013, each associated with a different 
statistic. In addition, the illustrative report 1000 includes a 
plurality of columns, such as columns 1051 through 1053, each 
associated with a different period of time, T. The value of the 
period, T, can optionally vary in accordance with the length of 
the content. For example, T could be 3 0 seconds for content 
having a length of 5 minutes, or 5 seconds for content having a 
length of 1 minute. 

The manner in which the exemplary statistics set forth 
in rows 1005 through 1013 are obtained was discussed above in 
conjunction with FIGS. 5 through 8. 

It is to be understood that the embodiments and 
variations shown and described herein are merely illustrative of 
the principles of this invention and that various modifications 
may be implemented by those skilled in the art without departing 
from the scope and spirit of the invention. 
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Claims 



What is claimed is : 

5. 1 . A method for presenting information to an audience, 

said method comprising the steps of: 

processing at least one of an audio and video signal 
generated by an audio/visual capture device focused on said 
audience to extract relevant characteristics about said audience; 
10 analyzing said extracted characteristics; and 

modifying said presented information based on said 

,^ analysis . 

%: 2. The method of claim 1, wherein said extracted 

US! characteristics include one or more demographic statistics . 

fU 3. The method of claim 1, wherein said extracted 

h\ characteristics include the current size of the audience. 

2<| 4. The method of claim 1, wherein said extracted 

characteristics evaluate how quickly said audience is changing 
over time . 

5. The method of claim 1, wherein said extracted 
25 characteristics evaluate the degree of attention the audience is 

paying to said presented information. 

6. A method for presenting information to an audience, 
said method comprising the steps of: 

30 processing at least one of an audio and video signal 

generated by an audio/visual capture device focused on said 
audience to extract demographic statistics about said audience; 
and 
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selecting said presented information based on said 
demographic statistics . 

7. The method of claim 6, further comprising the step 
5- of evaluating how said demographics change over time. 

8. The method of claim 6, further comprising the step 
of evaluating the degree of attention a given demographic segment 
is paying to said presented information. 

10 

9. The method of claim 6, wherein said demographics 
ps statistics evaluate said audience on the basis of at least one of 
^ age, race and gender. 

H 10. A method for presenting information to an 

audience r said method comprising the steps of: 

processing at least one of an audio and video signal 
d generated by an audio/visual capture device focused on said 
r:; audience to determine how quickly said audience is changing over 
20| time; and 

^ selecting said presented information based on said 

determination of how quickly said audience is changing. 

11. The method of claim 10, further comprising the 
25 step of evaluating how quickly said audience is changing for a 

given demographic segment. 

12. The method of claim 10, wherein information of a 
shorter duration is selected if a rate of change of said audience 

30 is below a predefined threshold. 



C : \TEMP\~ 0 040635. doc 



13. The method of claim 10, wherein information of a 
longer duration is selected if a rate of change of said audience 
is above a predefined threshold. 

14 . A method for presenting information to an 
audience, said method comprising the steps of: 

processing at least one of an audio and video signal 
generated by an audio/visual capture device focused on said 
audience to evaluate a degree of attention said audience is 
paying to said presented information; and 

adjusting a current selection of said presented 
information if said degree of attention meets predefined 
criteria . 

15. The method of claim 14, wherein said degree of 
attention is inferred on the basis of at least one of whether an 
individual is facing the display, changing body pose to face the 
display, changing body expressions, changing facial expression as 
the message is displayed, suddenly becoming silent, and starting 
to laugh/concentrate because of the content. 

16. A method for evaluating information presented to 
an audience, said method comprising the steps of: 

processing at least one of an audio and video signal 
generated by an audio/visual capture device focused on said 
audience to extract demographic statistics about said audience; 
and 

generating a report indicating said demographic 
statistics of said audience. 

17. The method of claim 16, wherein said demographic 
statistics indicate a size of said audience. 
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18. The method of claim 16, wherein said demographic 

statistics indicate a size of said audience for at least one 
demographic segment . 

5~ 19. The method of claim 16, wherein said demographic 

statistics indicate a rate of change of said audience for at 
least one demographic segment. 

20. The method of claim 16, wherein said demographic 

10 statistics indicate an attention level of said audience for at 
least one demographic segment. 

y3 21. A method for evaluating information presented to 

%1 an audience, said method comprising the steps of: 

W processing at least one of an audio and video signal 

71 generated by an audio/visual capture device focused on said 

TU audience to extract relevant characteristics about said audience; 
and 

yl generating a report indicating said extracted relevant 

ass : 

1Q characteristics about said audience. 

" 22. The method of claim 21, wherein said extracted 

relevant characteristics indicate a size of said audience. 

25 23. The method of claim 21, wherein said extracted 

relevant characteristics indicate a size of said audience for at 
least one demographic segment. 

24. The method of claim 21, wherein said extracted 

30 relevant characteristics indicate a rate of change of said 
audience for at least one demographic segment. 
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25. The method of claim 21, wherein said extracted 

relevant characteristics indicate an attention level of said 
audience for at least one demographic segment. 

5, 26. A method for evaluating information presented to 

an audience, said method comprising the steps of: 

processing at least one of an audio and video signal 
generated by an audio/visual capture device focused on said 
audience to evaluate a degree of attention said audience is 
10 paying to said presented information; and 

generating a report evaluating said degree of attention 
D said audience is paying to said presented information. 

Q 27. The method of claim 26, further comprising the 

H step of deriving a rate of change of said audience for at least 

Ly one demographic segment. 

p 28. The method of claim 26, wherein said extracted 

»3 relevant characteristics indicate an attention level of said 

M audience based on at least one demographic segment. 

29. A system for presenting information to an 

audience, comprising : 

an audio/visual capture device focused on said 

25 audience; 

a memory for storing computer readable code; and 

a processor operatively coupled to said memory, said 
processor configured to: 

process at least one of an audio and video signal 
30 generated by said audio/visual capture device to extract relevant 
characteristics about said audience; 

analyze said extracted characteristics; and 
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modify said presented information based on said 

analysis . 



"30. A system for presenting information to an 

5- audience, comprising: 

an audio/visual capture device focused on said 

audience; 

a memory for storing computer readable code; and 
a processor operatively coupled to said memory, said 
10 processor configured to: 

process at least one of an audio and video signal 

r=i generated by said audio/visual capture device to extract 

41 demographic statistics about said audience; and 

f-i select said presented information based on said 

IP demographic statistics . 



^ 31 . A system for presenting information to an 

p audience, comprising: 

Jf: an audio/visual capture device focused on said 

2Qj audience; 

*f a memory for storing computer readable code; and 

a processor operatively coupled to said memory, said 
processor configured to: 

process at least one of an audio and video signal 
25 generated by said audio/visual capture device to determine how 
quickly said audience is changing over time; and 

select said presented information based on said 
determination of how quickly said audience is changing. 

30 32. A system for presenting information to an 

audience , comprising : 

an audio/visual capture device focused on said 

audience; 
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a memory for storing computer readable code; and 

a processor operatively coupled to said memory, said 
processor configured to: 

process at least one of an audio and video signal 
generated by said audio/visual capture device to evaluate a 
degree of attention said audience is paying to said presented 
information; and 

adjust a current selection of said presented 
information if said degree of attention meets predefined 
criteria . 

33 • A system for evaluating information presented to 
an audience, comprising: 

an audio/visual capture device focused on said 

audience; 

a memory for storing computer readable code; and 

a processor operatively coupled to said memory, said 
processor configured to: 

process at least one of an audio and video signal 
generated by said audio/visual capture device to extract 
demographic statistics about said audience; and 

generate a report indicating said demographic 
statistics of said audience. 

34 • A system for evaluating information presented to 
an audience, comprising: 

an audio/visual capture device focused on said 

audience ; 

a memory for storing computer readable code; and 
a processor operatively coupled to said memory, said 
processor configured to: 
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process at least one of an audio and video signal 
generated by said audio/visual capture device to extract relevant 
characteristics about said audience; and 

generate a report indicating said extracted relevant 
characteristics about said audience. 

35. A system for evaluating information presented to 

an audience, comprising: 

an audio/visual capture device focused on said 

audience ; 

a memory for storing computer readable code; and 

a processor operatively coupled to said memory, said 
processor configured to: 

process at least one of an audio and video signal 
generated by said audio/visual capture device to evaluate a 
degree of attention said audience is paying to said presented 
information; and 

generate a report evaluating said degree of attention 
said audience is paying to said presented information. 
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ABSTRACT 



A method and apparatus are disclosed for tuning the 
' content of information presented to an audience, for example, on 
5- a large display screen or an information kiosk. A disclosed 
content selection and driving system (i) extracts relevant 
characteristics about the audience, (ii) analyzes the 
characteristics, (iii) modifies the presented content based on 
the analysis, and (iv) records relevant statistics for reporting. 
10 An audio/visual analyzer derives audience characteristics and 
other information on the public reaction to the presented 
5 advertising or information by analyzing audio or video 
S information, or both. The derived characteristics are utilized 
O to tune the content of the presented advertising or information 
I§ to the characteristics of the current audience. A reporting 
W module receives real-time audience statistics and an indication 
of the selected content. Reports can be generated for the 
O content provider, such as advertisers, that indicate the exposure 
ii: of various population segments to the presented content and the 
W reaction of the audience to the presented content. 
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As a below named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated below next to my name. 

I believe I am the original, first and sole inventor (if only one name is listed below) or an original, first and joint 
inventor (if plural names are listed below) of the subject matter which is claimed and for which a patent is sought on the 
invention entitled Method and Apparatus for Tuning Content of Information Presented t o an Audience 
the specification of which (check one) 
X is attached hereto. 

was filed on ___ as Application Serial No. and was 

amended on 

(if applicable). 

I hereby state that I have reviewed and understand the contents of the above-identified specification, including the 
claims, as amended by the amendment(s) referred to above. 

I acknowledge the duty to disclose information which is material to the patentability of this application in accordance 
with Title 37, Code of Federal Regulation, 91.56(a). 

I hereby claim foreign priority benefits under Title 35, United States Code, 3 1 19 of any foreign application(s) for 
patent or inventor's certificate listed below and have also identified below any foreign application for patent or inventor's 
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APPLICATION SERIAL 
NUMBER 
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IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 
In re Application of Atty. Docket 

ERIC COHEN-SOLAL ET AL US000149 
Serial No. 
Filed: CONCURRENTLY 

Title: METHOD AND APPARATUS FOR TUNING CONTENT OF INFORMATION 
PRESENTED TO AN AUDIENCE 

Commissioner of Patents and Trademarks 
Washington, D.C. 2 0231 
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Sir: 
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